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Abstract. We are consider domains in cotangent bundles with the property 
that the null foliation of their boundary is fibrating and the leaves satisfy a 
Bohr-Sommerfeld condition (for example, the unit disk bundle of a ZoU met- 
ric). Given such a domain, we construct an algebra of associated semiclassical 
pseudodifferential operators with singular symbols. The Schwartz kernels of 
the operators have frequency set contained in the union of the diagonal and 
the flow-out of the null foliation of the boundary of the domain. We develop 
a symbolic calculus, prove the existence of projectors (under a mild additional 
assumption) whose range can be thought of as quantizing the domain, give a 
symbolic proof of a Szego limit theorem, and study associated propagators. 
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1. Introduction 

Let M be a smooth compact manifold, and <Z X := T*M a closed compact 
domain with a smooth boundary. In this paper we address the question: what 
quantum objects are naturally associated with Xc? This question has been ad- 
dressed indirectly in "classical" cases. For example, if Xc is the unit disk bundle 
associated to a Riemannian metric on M assumed compact, then morally speaking 
to Xc corresponds the (^-dependent) subspace V. of L'^{M) spanned by the eigen- 
functions of the semiclassical Laplacian, P = h'^A, with eigenvalues in [0, 1]. This 
heuristics is in good measure justified by the theorem that, if 11 : L^(M) Ti is 
the orthogonal projection, then for any ^-pseudodifferential operator Q one has: 

(1.1) lim — - — TrnQn = ^^ — / QdX, 

where Q is the principal symbol of Q and dX is Liouville measure (see [E])- But 
can one say more? 

We discuss a more systematic answer to this question in the case when Xc is 
"fibrating and Bohr- Sommerfeld" , by which we mean the following. The boundary 
dXc is always foliated by curves tangent to the kernel of the pull-back of the 
symplectic form. The fibrating condition is that there exists a manifold S and a 
submersion vr : dXc — )■ S whose fibers are the leaves of the null-foliation. This 
is satisfied iff Xc has a globally defining function whose Hamilton fiow on dXc is 
periodic with a common minimal period. The Bohr-Sommerfeld condition is that 
all leaves, 7, of vr satisfy 

a G 27rZ, 



7 

where a is the tautological one- form in T*M. We will show that under these 
conditions there exist spaces J^'"^ of pseudodifferential operators with singular 
symbols naturally associated with Xc- (Here {i, m) is a bi-degree, to be explained 
later) . The frequency sets of their Schwartz kernels are contained in the union of 
Lagrangian submanifolds of T*{M x M) 

A'cUJ^dX'c, 
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where 

Ac = {{x,x) GXcX Xc} 

and FdXc is the flow-out 

FdXc = {(x, y) G dXf. x dX^ ; x, y in the same leaf }. 

Intuitively speaking, the diagonal part, Ac, is expected to be a part of any pseu- 
dodifferential operator calculus associated with X^- The flow-out part, FdXc, 
is there because the flbrating-and-Bohr-Sommerfeld conditions imply that there 
should be a signiflcant part of Hilbert space associated with the symplectic reduc- 
tion of the boundary of Xc- The two symbols, one on Ac and one on J-dXc, have 
a compatibility condition that comes about most naturally in our setting. 

In particular, the space J~^/2'i/2 jg closed under composition, and it includes the 
projector 11 mentioned above, in the case of Zoll metrics. The Bohr-Sommerfeld 
condition is needed for the existence of a global symbolic calculus, and goes 
along with having to restricting Planck's constant to take the values h = 1/N, 
N = 1, 2, . . .. The flbrating condition is needed in order for J-dX^ to be a closed 
submanifold oi X x X. 

The Schwartz kernels are semiclassical analogues of the oscillatory integrals 
with singular symbols of [22] and [11], associated to a pair of intersecting conic 
Lagrangian submanifolds. See also [19], where a precise calculus for a more gen- 
eralized class is discussed, and [16] where a connection with a class of Legendre 
distributions is explained. In the conic case, the realization that if the Lagrangians 
are the diagonal and a flow-out one obtains a symbol calculus is due to the results 
in [T]. This is possible because 

Ac o FdX^, TdXc o Ac, TdX^ o TdX^ c TdX^ ; Ac o Ac C Ac, 

so composing two operators with wave-front set in AcU J-"(9Xc produces an operator 
with wave- front set contained in the same union. We believe that the present 
semiclassical setting provides a very natural expression for the Antoniano-Uhlmann 
algebra. 

In the Zoll case, there have been numerous papers aimed at refining the general 
result (jl.ip . mostly in terms of the reminder estimate. For instance, in [8], the 
second term in the Szego formula for Zoll manifolds is proved. Other references in 
this direction are [21 El ED [2D1 [M] • 

Here we are not focusing on remainder estimates, but on the fact that there is 
an operator algebra with a symbolic calculus that provides a quantization of X^ 
and, among other things, a broader (symbolic) setting for Szego limit theorems. 
Furthermore, the existence of the operator algebra allows us to go farther in the 
analysis of the operators IIQII mentioned above, with respect to previous works. 
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The issues we raise here are also connected with work of [7], on the rela- 
tionship between symplectic cutting and quantization, in the homogeneous (non- 
semiclassical) category. They consider the case when Xc = (p~^{—oo,0] where 
: X — 7- M is the moment map for a homogeneous action of the circle group on 
S^. In this setting one can form the symplectic cut 

Y = XJ ~, 

Their work centers on the algebra of operators {HQII ; [H, Q] = 0} where Q ranges 
over (non-semiclassical) ^'DOs on M and 11 is a spectral projector, as above, 
associated to a quantization of the circle action by a Fourier integral operator. 
Roughly speaking they show that such an algebra can be considered a quantization 
of the symplectic manifold Y. 

1.1. Main results. We now describe our main results. 

Theorem 1.1. LetXc C T*M be as above (dX^ "fibrating and Bohr- Sommerf eld"). 
Then there exist vector spaces of semiclassical pseudodifferential operators with 
singular symbols, J^'"^[M x M; A,TdXc), where h is restricted to the sequence 
1/N,N = 1,2,. . ., such that: 

(1) The frequency set of the Schwartz kernel of any operator in the algebra is 
contained in the union A' U TdX'^. 

(2) Let S = Ar\J-dXc. Then J^'™ are microlocally Lagrangian states of order 
i + m on A' \T,' and i on TdX'^\Ti' , and therefore there are symbol maps: 

ao : J ^ I A |i/2(A \ S), ai : J ^ \ ^ \^/^{FdXc \ S) 

(where | A|^/^ denotes the space of half- densities, and we will ignore Maslov 
factors). There is in fact a symbolic calculus, that will be described below. 

(3) J^'™ o /'™ c j'?+£+i/2,m+m-i/2^ particular J-1/2,1/2 algebra. 

(4) Assume that X^ is compact. Then every 

A £ ^ M;A,TdXc) 

with microsupport contained in Xc is smoothing and 

Tr{A) = (27r)-" /i"" / ao(I) + Oih-^+' log(l//i)) 

where oj is the symplectic form ofT*M and n is the dimension of M. 

The manifold Xc has an associated operator algebra, Ax^, which consists of 
elements in the algebra J {M x M; A, dXc) which are microlocally of order 0{h°°) 
in the complement T*M\ Xc. 
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Theorem 1.2. (See ^5.il for details.) Assume dXc is compact and of contact 
type. Then there exist orthogonal projections 11 G j~i/2.i/2 ^ufiQgg symbol do is 
the characteristic function of Xc- Moreover, for any zeroth-order pseudodifferen- 
tial operator on M , Q, the "cut" operator HQH is in the algebra, and gq can he 
identified with Q\xc- 

As an immediate corollary we obtain the following Szego limit theorem: 

Corollary 1.3. Assume that Xc is compact, IT G J~i/2.i/2 orthogonal projector 
as in the previous theorem and let K = 1/N . Then for any integer m > 

Trfngn)™ = (27r)^" Af" / Q"" ^ + 0(iV"-i log(iV)) 

Finally, we have a result on the propagator He"**'' ^ngn ^j^g^g ^j^g symbol, Q, 
of the pseudodifferential operator Q preserves X^ "to second order" : 

Theorem 1.4. Suppose Q is a zeroth-order semiclassical pseudodifferential oper- 
ator satisfying the conditions of Lemma \6.1[ Assume subQ{h) = 0. Then 

^^-m-^UQn g j-i/2,1/2 ^ M;A{t),TdXc{t)) , 

where 

A(t) = {(x,y) \x,y G T*{M x M),x = ^f{y)} 
TdXcit) = ^{x,y) \x,y £ dX^, 3s G M such that x = ^>f $f . 

Remarks: 

(1) The result on the trace (part (4) of the Theorem II .ID extends to the spaces J^'™- 
provided m > —1/2. If m is sufficiently negative, the leading contribution to 
the trace comes from the asymptotic singularity of the kernel of the operator at 
E. 

(2) The symbol calculus for do is just the usual pseudodifferential calculus. The 
symbol calculus for ai is more complicated (and non-commutative). In fact fJi 
comes with an extension to a distribution on J-dXc conormal to S, and there 
exists a formula for the smooth part of the cti of the composition in terms of the 
corresponding extensions of the factors. 

(3) The restriction that h = 1/N is necessary to have a well-defined global symbol 
on the flow-out J-dXc, see |14j chapter VII, §0. Locally elements of the J^'"^ are 
given by semiclassical oscillatory integrals with ^ — )• continuously. 

(4) The error estimate 0(^log(l/^)) is sharp for the class J~^/^'^/^, but in Corollary 
ll.3l the error should be 0{h?), see Remark 14.41 
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(5) The idea that the image of 11 quantizes Xc and that the operators IIQII can be 
considered as associated observables appeared first in the physics hterature, see 
[2] §11 E and [3] (where a connection with symplectic cutting is also made). The 
operators IIQIl do not form an algebra, however, while the class J"^/^'^/^ does. 

(6) Our work also implies that the results of [7j also hold in the semiclassical case. 

The paper is organized as follows. In Section [21 the spaces J^'™ are defined in 
a model case by oscillatory integrals with amplitudes having expansions in h with 
coefficients that are classical symbols. In Section [3l the spaces are defined globally 
on manifolds, and the existence of a symbolic calculus is established. The principal 
symbol on each Lagrangian blows-up at the intersection, and they satisfy a symbolic 
compatibility condition there. The theorem on the trace is proved in Section 21 
Section O considers cases where the algebra admits projectors, yielding a symbolic 
proof of a generalized Szego limit Theorem. Section [6l studies the propagator 
of certain elements in the algebra, and proves an Egorov-type theorem. Finally, 
Section [71 shows numerically a surprising phenomenon of propagation of coherent 
states in situations not considered in Section [6l 

2. The model case 

2.1. Definitions. We begin by discussing the microlocal model case: M = and 
-^c — {Pi ^ 0}) where (xi, . . . ,Xn,Pi, ■ ■ ■ ,Pn) are canonical coordinates in T*]R". 
Let !FdX2 be the flow-out of dX^ = {pi = 0}. We will use this case to define 
operators J^'™(R" x M"; A", where A" C T*R" x r*M" is the diagonal. 

Roughly speaking, elements in J^'™(]R" x R", A", J^(9X") will be defined as 
oscillatory integrals with amplitudes as follows: 

(1) We denote by A^'"^ the class of all smooth functions a{s,x,y,p,a,h) with 
compact support in s,x,y,p such that, as /i — )■ 

oo 

a{s,x,y,p,a,h) ~ ^ n?aj{s,x,y,p,a) 
j=-e 

(in a sense that will be explained below) where, for each j, aj{s,x,y,p,a) 
is a poly homogeneous classical symbol in a of degree m: 

— oo 

aj{s,x,y,p,a) ~ ^ aj^r{s,x,y,p,cr), VA > aj^r{s,x,y,p, Xcr) = X'aj^r{s,x,y,p,a). 

r=m 

(2) The operators in J^'™(R" x R"; /X^,FdX'^) are those whose Schwartz ker- 
nels are of the form 

(2.1) 

^^"'^'^^=(^/^' 
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{xi-yi-s)pi+{x' -y')p' 



T il n n f)\ rift rln rirr 



where we have split the variables: x = (xi,x'), y = {yi,y') {x' ,y' G M" ^). 
We now give the details. 

Definition 2.1. Let [x, y) and s be the standard coordinates on M^" and M respec- 
tively, and let p, a be the dual coordinates to x, s. We denote hy z = (x, y, s) coor- 
dinates in M^" X M. Define to be the space of smooth families a{s, x, y,p, a, h) 
compactly supported in z, p such that 

(2.2) {d/dpf {d/day a < Ch-\l + |cj|)"^-l^l , 

for some constant C = C{a,f3,'j) and h G (0,/io] for some fixed /iq > 0. 

Let aj{s, X, y,p, a) £ 5™ be a sequence of classical symbols in the a variable, of 
order m, and compactly supported in {s,x,y,p), i.e., aj is smooth, 

{d/dzr {d/dpf (d/dar a,{s, X, y,p, a) < C{a, /3, 7) (1 + , 



for some constant C = /3,7), and there exists a sequence aj^r of smooth 
functions in a - 
the standard se 
integers K > 



functions in cj 7^ 0, homogeneous of degree r in a, such that aj ~ X^r=^ '^j,r ™ 
the standard sense. Given a G we will say that a ~ Yl^L-e f^'' (^j iff fo^ 



a- Waj G ^'^-^-1''". 

Definition 2.2. Denote by ^classical ^^'"^ the set of all a{s, x, y,p, a, h) that sat- 
isfy a ~ Y.f=-i f^^aj, as above, and let S" = A"nJ"5X^". Define J^'™ (M" x M"; A", TdX^) 
to be the set of kernels of the form 



A{x, y, h) + Fi{x,y,h) + F2{x,y, h) 

where A{x,y,h) is as in (j2.ip with a G ^cli^ical where 

i' = i + 1/2, m' = m- 1/2, 

and Fi , F2 are the kernels of semiclassical Fourier integral operator in 
sc - 1^+'" (M" X M"; A" \ S"), sc - (M" x M"; I'dX^), respectively. 

Remark 2.3. As we will see, it is necessary that Fi and F2 appear in the definition 
in order for the classes J to be closed under composition. 



We have yet to give sense to the formula in equation (j2.ip . Denote by Z? = l+D^ 

where = i£. Notice that De'"'' = (1 + cj2)e^^'". For a G ^Sicai' we define 

A{x, y, h) as 

(2.3) 

^^^'^'^^ = (2^ / ^'""^""^^^^"" (1 + ^2);^^ -^" [e-^'^'''P^a{s,x,y,p,a,h)) dsdpda. 
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The integral above is absolutely convergent for >> large enough since 

is 0(0"™). It can be easily checked that the definition above does not depend on k 
using integration by parts. 

Equivalently, one can define the integral in ()2.ip as an iterated integral, where 
one first integrates over the variables {s,p) with respect to which the amplitude 
is compactly supported. The resulting function of a is rapidly decreasing and 
therefore integrable. Both of these interpretations are useful in proofs. 

We now state the first property of the kernels we have just defined: 

Proposition 2.4. For any A G J^'™ (M*^ x W; A'',TdX^), the frequency set of 
A is contained in the union of the Lagrangians A" and J-dX^: 

FS{A) c A"'U-F9Xf . 

Moreover, away from the intersection S = A" D FdX^ , A is microlocally in the 
space sc-l'^+'^ (R" x M"; A" \ S*^) and sc-I^ {R"- x R"-; FdX^ \ S*^), where sc-I de- 
note the spaces of semiclassical Fourier integral operators. 

Remark 2.5. This is a consequence of Theorem 13. 131 proved in Section [3.31 

2.2. The symbol maps. By the second part of Propositon 12.41 has two 

symbol maps: 

do/ |A|i/2(A"\S) 

(2.4) J^''" (M" X M"; A'^, TdX^^) 

ai\ \^\^/\T^X-\T.). 
It is easy to see that, for A as above, they are given by the following formulae: 

(To(A) := 27r a^ii^m'is, x, y,p, a)yjdxdp\ and 

(2.5) 

CFi{A) := \/2tt f a-er{s, x, y,p, a)e'^^" da^Jdxdyidp' \ 

Notice that ctq has a singularity as a = pi converges to zero, that is, as the point 
where (Tq is evaluated tends to the intersection, S. The same is true of cji, and 
the leading singularities of gq and cti are Fourier transforms of each other. This 
is exactly as in §5 of |11] , and (appropriately understood) will be true in the 
manifold case as well. 

Proposition 2.6. One has the following exact sequence: 

Q ^ jt,m-l ^ je-l,m _^ jl-m ^ Jl^^^^n \ S) ^ 0. 



Here i?™'(A" \ S) is, roughly speaking, the space of smooth functions on A" \ S 
that have singularities of degree m at S in the normal directions (for details we 
refer to [11], §5 and §6). 

The classes of operators with kernels in the J^'"^ are closed under composition 
in the following sense: 

Proposition 2.7. The composition of properly supported operators with kernels 
in J^'™ and J^'™, respectively, is an operator with kernel in j^+^+i/2,m+m-i/2_ 
particular J~^/2'i/2 {g algebra: 

j-l/2,1/2 Q j-1/2,1/2 ^ j-1/2,1/2^ 

and for any u G J^'"^, v S J^.™ ^ yj^ obtain (ignoring Maslov factors and half- 
densities): 

ao{uov){x,x) = ao{u){x,x)ao{x,x), ai{x,y) = [ ai{u){x, z{t))ai{z{t),y)dt, 

V 2-K J 



where z{t) is the bicharacteristic curve joining x and y. 

Note that, by the symbol calculus for semiclassical FIOs ([TO]) there are formulae 
for the symbols ctq, cti, of the composition. (Microlocally near A \ S the operators 
are pseudodifferential and the symbol calculus for do is the usual one). We will 
have more to say about the symbol calculus in the next section. 

Proof. (Our proof follows the lines of the proof of Theorem 0.1 in [l].) It is not 
hard to show that the classes J are closed under composition by operators Fi, F2 
as in definition 12.21 Therefore we start with kernels as in (|2.1|) . It is also not hard 
to show that it suffices to prove the theorem in the case when the amplitudes of 
these kernels are independent of h, in which case 1 = 1 = —1/2. Let us therefore 
consider 

where a and a are classical symbols in a and a of orders m' = m — 1/2 and 
fh' = rh — 1/2, respectively. For xo ^ function that vanishes near the origin, and 
1 outside a compact support, we have 

"^^^'^^^ (2^ / e*'"^^""'^''"''''^^"''«(^'^'y'^''^)xo(^T)dsdpda + £(, 
^(^'^) = 7^7^^ / e^'"'"((^-^)™)+'^'''a(5^y,z,p,a)xo(cr)d5dpda + i) 



where u, v ^ sc-I^ (M" x W^; J^dX^)- We can therefore assume that a, a are zero 
near a = 0, a = respectively. The composition has Schwartz kerneh 

uj{x,z) = ^^J^^^ j e''"^''" DdsdSdadddp, 

with 

D = i^^lny j ^'^(a-d) {s,s,x,y,z,p,p,a,a)dydp, 

where 

(p = {x - y)p + {y - z)p - spi - spi. 

The critical points for this phase for each x, z, p fixed are: p = p, y' = z' , yi = zi—s. 
So, by the stationary phase theorem, we obtain: 

D ~ e'^''^^y=^'^-''''^'P=P^a(^s,x,y = {zi - ~s,z'),p,a) d(^§,y = (zi - s,z'),z,p,a) 

as ^ — 7- 0. Stationary phase in fact gives us a complete asymptotic expansion in 
increasing powers of h, with coefficients derivatives of a and a evaluated at the 
critical points. It suffices to consider the contribution to lo of the leading term in 
the expansion of D (the other terms are treated in the same manner): 

, .^l'™ ^\ — ^ f ih-'^[(x'-z')p'+{xi-zi-s-s)pi]+isa+isa 

uo[x,z) .- je 

a{s, X, (zi — s, z'),p, a) d{s, (zi — s, z'), z,p, a) dsdsdpdadd. 
Making the change of variables t = s + s, we can write 

where 

Next, we split loq in three parts, as follows. 

Let Xk = Xfc(f'')Cr)i A: = 1,2 be smooth, classical symbols of degree zero such 
that 

{1 for |cj| < \e\a\ ( 1 for \a\ < \e\a\ 

and X2 = < 
for |cr| > e\a\ y for \a\ > e\a\ 

for e << 1. We let 
and 

Q — UJQ — Li — l2. 
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We will show that T^, A; = 1, 2 is a semiclassical state in the flow out while Tq is 
an integral of the form (j2.ip . 



Let us rewrite, for k = 1,2, 



where 



Ck{x,z,t,p) := j e'^^+''^''~^^Xkaddsdada, 



interpreted as an iterated integral (first with respect to s). On the support of xi 
one has |<t| < e|<T| which implies |<t — (t| > \a\ — \a\ > (1 — and therefore 



for all > 0. Since a d vanish near a = = a and xi vanishes in a conic 
neighborhood of the diagonal, we can integrate by parts repeatedly to obtain 

Ci{x,z,t,p)= [ (,ii^+is{<r-a) — XI D^{ad)dsdada. 

J {-i)"{a-(T)" 

Since {ad) is of the same order in a, a and N is arbitrary, Ci is Schwartz in the 
variable t. Applying once again the method of stationary phase this implies that 

jh-Hxi-z^~t)p,fj^^^^ z, t,p) dpi dt 

is a semiclassical symbol and therefore Ti is a semiclassical state on the flow out. 
The proof for T2 is analogous. 

To show that Tq is as desired we only need to show that 



bo{t,x, z,p,d-) = ye*"**^"" '^^a{s,x,{zi - t + s,z'),p,a) 

d{t - s,{zi-t + s, z'), z,p, a) (1 - xi(o-, ^) - X2{cr, a)) dsda. 

is a classical symbol in a of order m' + rh' . 

Making the change of variables r = S , we obtain: 

jis(r-l)^|-g^^^ (Zi - t + S, z'),p,aT) 

d{t - s,{zi - t + s, z'),z,p,d-){l - xi{^T,a) - X2{^T,a))dsdT. 



Notice that r is bounded in the support of the amplitude, and so using stationary 
phase in a, we get an expansion for 69 in terms of a, where the leading term is 

b ~ 27ram'(0, X, (zi - t, z ),p,a) drh>{t, {zi - t,z),z,p,a), 

and we conclude 6 is a classical symbol in d of degree m! + rh' . 
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The symbol of uj{x, z) in the diagonal is easily computed as: 

aQ{u:){x,z = x) = 2Trbm'+rh'{t = 0,x,z = x,p,pi = a) 
= {2TT)^am'{0, X, z = x,p,d- = pi)dfh'{t = 0, z = x, z = x,p,a = pi) 
= ao{u){x, z = x)ao{v){z = x, x). 

The symbol in the flow-out is the sum of the principal symbols of each summand 
at {t = zi — xi, x' = z' , zi — t + s = xi + s), which after the cancellation of xi, X2i 
reduces to 



27r I e'^^e''^''-^'^a{s,x,{xi+s,x'),{0,p'),a) 

a{t — s, (x — 1 + s, x'), {zi,x'), {0,p'),a)dsdada 

^j(^V2^ j e'"'a{s,x,{xi + s,x'),{0,p'),a)da^ 

(v2^/...-.»<.,-M.. + ..'),(^...').(o,p')..V.)<i» 

ai{u){x, {xi + s,x'), {0,p'))ai{v){{xi + s,x'), {zi,x'), {0,p'))ds. 

□ 



3. The manifold case 

3.1. The spaces J^'"* on manifolds. In this section we extend the definition of 
the spaces J^'™ to the manifold case. Let M be a C°° manifold of dimension n, 
and Xc C r*M be a compact domain with smooth boundary contained in the 
cotangent bundle. The boundary dXc is then foliated by curves tangent to the 
kernel of the pull-back of the symplectic form. In addition, we assume that the 
fibrating and Bohr-Sommerfeld conditions are satisfied, i.e., the leaves of the null 
foliation are the fibers of a submersion vr : dXc — )• S, and for each leaf 7 C dXc, 

(3.1) / a G 2-kZ, 

where a is the tautological one-form in T*M. 
Definition 3.1. Given Xc as above, define the fiow-out 

(3.2) TdXc := {{x,y) \x,ye dX^, x,y are in the same leaf} C T* (M x M) . 

The condition that dXc be fibrating easily implies that TdX is a closed sub- 
manifold of T* (M X M). 
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Lemma 3.2. There exists an open neighborhood dXc C U C T*M of dXc, and a 
map 

(3.3) P:U 

such that zero is a regular value of P, dX^ = P~^{^), the orbits of the Hamilton 
flow generated by P are 27r periodic on the boundary dX^, and coincide with the 
leaves of the foliation. 

Remark 3.3. Prom now on we will fix a defining function of X^^ P, with the 
properties of this Lemma. 

Proof. There exists U and F : {/ — t- M such that dXc = ^"""^(0), where zero is a 
regular value. The Hamiltonian vector field 'Sp is tangent to F~^{0) = dXc, and 
therefore the trajectories of the Hamiltonian F coincide set-theoretically with the 
leaves of the foliation. In particular, they are periodic. For each x G dXc, let T(x) 
denote the minimal period of the trajectory through x. The fibrating condition 
can be seen to imply that the function T is smooth. Extend this function to a 
smooth function T : [/ — )• M"^. The defining function that satisfies the conclusions 
of the lemma is then 

T 

P= — F 
27r 

□ 

Remark 3.4. Notice that the boundary dXc of Xc may not be connected. In those 
cases, the flow-out TdXc consist of the union of Lagrangian that are pairwise 
disjoint. 

Let A C r* (M X M) be the diagonal in T* {M x M). 
Lemma 3.5. The diagonal and the flow- out {A,J^dXc) intersect cleanly. 
Proof. Let (x,x) G A n FdXc. It is easy to show that 

T(ji,x)^dXc = {{5x + rEp{x), 6x)\6x £ T-rdXc, r G M} , 

and so 

%,^)A n = {{5x, 5x)\6x G T^dX,] = T(^,^) (A n FOX,) 

□ 

By an analogue to Proposition 2.1 in [11], there exists a locally finite covering 
{Ui}i of A n FdXc, Ui C T*{M x M) open and contractible, where each Ui 
intersects only one connected component of FdXc, and for each Ui a canonical 
transformation 

mapping C/jnA to A", and UiCiFdXc to FdX^, where A"-,FdX^ are the diagonal 
and fiow-out in the model case, respectively. 
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Definition 3.6. Let S = A n TdX^ be the intersection of the diagonal and the 
flow-out. The space J^'™ (M x M;A,J-'3Xc) is the set of families of functions 
A{x^ y, h) which can be written in the form 

A = Ao + Ai + J2^i 

where: 

(1) ^0 G sc-/^+'" (M X M; A \ S) and Ai G sc-I^ (M x M; TdXc), and 

(2) uJi is microlocally supported in Ui and is of the form 

Ui = Fi{vi), 

where Vi G J^'™ (M'^ xR''; A'',TdX2) and Fi is a semiclassical Fourier 
integral operator associated to xi^ ■ 

Remark 3.7. As in one can show that the definition does not depend on the 
choice of the semiclassical FIOs Fi. 

Proposition 3.8. In the general case the conclusion of Proposition still holds, 
namely: Operators with kernel A G J^'"^ {M x M; A,TdXc) have frequency set 
contained in the union 

FS{A) c A' U TdX'^. 

Away from the intersection S they are microlocally semiclassical Fourier integral 
operators sc—I^^"^ (M x M; A \ S) and sc—I^ {M x M, FdXc \ S) respectively. Fur- 
thermore, one has well-defined symbol maps (ignoring Maslov factors) 

do/' |A|V2(A\S) 

(3.4) J^'™ (M X M; A,FdXc) 

ai\ I A|i/2(j-aXe\S). 

The proof of the existence of the symbol calculus is the subject of the following 
section. 

Our construction, in particular, gives a way to associating to Xc an algebra of 
operators, which can be thought of as a quantization of X^. 

Definition 3.9. We will denote by Ax^ the space of elements in J {M x M; A, dXc) 
that are microlocally of order 0(/i°°) in the complement of Xc- 

It is not hard to see that Ax^ is indeed closed under composition. (Elements in 
this algebra correspond to amplitudes that are of order — oo in a as o" — t- — oo.) 
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3.2. Symbolic calculus. Here we discuss liow Proposition 13.81 can be proved (for 
h tending to zero along certain sequences) using the methods from [23]. We begin 
by recalling the ideas and results from op. cit. that we will need. 

The pre-quantum circle bundle of T*M can be identified with the following 
submanifold of T*{M x S^): 

Z = {{x,e;^,K) G T*{M X 5^) ; K = 1}, 

with the obvious circle action. The connection form, a, is the pull-back to Z of 
the canonical one form of T*{M x S^). 

Definition 3.10. ([23]) A Lagrangian submanifold A C T*M will be called ad- 
missible iff there exists a conic Lagrangian submanifold, 

ACT*{M X S^)r\{K>0} 

such that 

(3.5) A=(Anz)/5^ 

We call such a A a homogenization of A. 

It is not hard to see that A is admissible if and only if it satisfies the following 
Bohr-Sommerfeld condition: There exists : A — )• 5^ such that 

i*ri = d\og (j), 

where i : A — t- r*M is the inclusion and r] the canonical one form of T*M. Given 
such a (p, a homogenization of A can be defined by: 

(3.6) A = {e*^ = (t>{X), K > 0}. 

Definition 3.11. Let M be a C°° manifold and consider a family of smooth 
functions {ipn}- The h transform of the family tpfi is the following distribution (if 
the series converges weakly) in M x 5""^: 

oo 
m=0 

The main point of the previous two definitions is the following 

Lemma 3.12. i^|23] ] The h transform of a semiclassical state associated to an 
admissible Lagrangian is a Lagrangian distribution associated to a homogenization 
of the Lagrangian submanifold. 

We claim that the previous lemma generalizes to our spaces J^'™ of semiclassical 
pseudodifferential operators with singular symbols, so that the h transform of their 
kernels are Guillemin-Uhlmann operators (i. e. those defined in [11]) on M x S^. 
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Thus we now consider A to be the diagonal in T* (M x M) and J-dXc as in 
(j3.2p . Clearly a homogenization for A is the diagonal A of T* (M x 5^)^ = 
T* [M X 5"^) n{K > 0}. Let P be a globally defining function for dXc with periodic 
Hamilton flow on it, as in ()3.3p . Then a homogenization for J-dXc is the flow-out 
of the homogenization of P, which is the function P : T* {U x S'^)"'' — )■ M defined 
as 

P{x,e''-i,K) = KP{x,i/K), 
where U is the neighborhood of dXc described in Lemma |3.2[ Specifically, 

(3.7) TdXc = { (^'f (x, e*^ ^, k) ; (x, ^, k)) | s G M, k > 0, P{x,^/k) = o} 
where <l?f is the Hamilton flow generated by the equations (here p = ^/k) 



^ = -K^{x,p), k = 0. 



Notice that J-dXc is closed if the flow <I>f is 2tt periodic, which happens if the 
Bohr-Sommerfeld condition 

/ pdx G 27rZ 

is satisfied for orbits 7 C dX^ of P. The function (j) ■ J~dXc — )• associated to 
this homogenization is 

0(x,y) = e-^&^ 

where Jl pdx is the action from x to y, and the integral is taken on the curve in 
the leaf joining x to y. 

3.3. The existence of the symbolic calculus. Notice that A and FdXc in- 
tersect cleanly. As a result, their homogenizations A and TdX^ are conic and 
intersect cleanly too, forming an intersecting pair, in the sense of |22^ lllj . The 
relationship between the semiclassical objects defined above and the operators 
described in [TT] is as follows: 



Theorem 3.13. Let /S.,TdXc he as above, and A,J^dXc their homogenization, 
respectively. Then any operator A € (jyf x M ; A,J^dXc) if and only if its 

h-Transform belongs to (m x x M x ; A,TdXc 



Proof. We sketch the ideas of the proof in the model case. Let A{x, y, H) be as in 
equation (j2.ip . Let us assume first that the amplitude j2^f^o, does not depend on 
h so that 

A{x,y,h) = j e'''''^^'''-y'"'^P'-'^'''-y'^P'^+''''a{s,x,y,p,a)dsdpda, 
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where a{s,x,y,p, a) is a classical symbol in cj of order m' = m— 1/2, and compactly 
supported in s,x,y,p. The ?i-transform of A is then 

oo „ 

A{x,e,y,a) = Y^ / e^^[(^i-^i"'^)Pi+(^'-J'>'+(^-")l+^^"o(s,x,y,p,(j)ds(ipd(j 
k=i •' 

^i[{x^-yi-s)rn+(x'-y')p'+{9-ct)\ 

This distribution is the push-forward under the projection (s, x, y, 0, a,p) — )■ (x, y, 6*, q) 
of the product of the distributions 

(,i[{^i-yi-s)pi+(x' -y')p' +{e-a)\ 
r{s,x,y,e,a,p) = ^ _ 

and 

T(s, X, y, 61, a,p) = j e*^'^a(s, x, y, cr)(i<T. 

r is a distribution in space conormal to the hypersurface {xi—yi — s)pi + {x'—y')p' = 
— {6 — a), while T is a distribution conormal to s = 0. Therefore, A(x, 9, y, a) is a 

Guillemin-Uhlmann distribution associated to the pair ^A"' , J^dXj}^ . The general 

case (i.e. when a also depends on h) is an asymptotic sum of derivatives and 
integrals (with respect to the 9 variables) of the previous case. The converse is 
also true, and the proof is analogue to that in [23] for semiclassical states. □ 

This proposition together with Proposition 2.4 of |23j . relating the frequency set 
of an /i-dependent vector and the wave-front set of its h transform, implies part 
(1) of Theorem ll.il 

The symbols of operators in J^'™'(A, J^9Xc) are the reduction of the symbols of 
its /i- Transform, in the following sense. Let x, y € J^dXc \ S, x = <^>f (y) for some 
s e M, and take 

{x, y) = ($f (y, e*^=° = 1,k = 1), (y, 6^^=° = 1, k = 1)) G FdX-. 



Using (|3.7p . we obtain an isomorphism between T^^^y^J^dXc and Tj-^^y) J^5Xc xMxM, 
which leads to 

(3.8) = \T^^,y)TdX, X M X M|'/' ^ 

Therefore, every half-density in T^^ y-^TdXc will define a half-density in Tf^-^ y^^TdXc- 

Let S = J-^Xcf^A.. For each family A G J^'*", denote its /i- Transform by A. There 
is a well defined symbol map 

?r = CTi(l) EC°°(j^e\S,0;(g)L;), 
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where is the bundle of half-densities on J^dXc, and Li is the corresponding 
Maslov bundle. Ignoring Maslov factors, we can define the symbols on J-dXc \ S 
by the identification (j3.8p . i.e., restricting the symbol of the ^-Transform to ^ = 0, 
K = 1 (o"i = 5i I ). The construction of the principal symbol on the diagonal 

is similar. 

Let = A" n TdXJ}, = A" n fdxj}. In the model case, we know by [II] 
that A{x,6,y,a) is microlocally in 

je+m l^^n X X ; \ S") , and (r'' x x x ; fdJq} \ S") . 

Therefore An is microlocally in sc-/^+™ (M" x M"; A" \ S") and 

;J-dX^ \ S") in the sense that the /i-transform is microlocally in 
their corresponding spaces. We have proved the following 

Proposition 3.14. 

n^/''" = sc-/°° (M"xM";A") 

and 

n^/'™ = sc-f (M" X W;TdX^) . 

3.4. A symbolic compatibility condition. Recall that the foliation of dXc is 
fibrating, i. e., there exists a Hausdorff manifold S and a smooth fiber map 

(3.9) vr : dX^ S, 

whose fibers are the connected leaves of the foliation defined Section [3. II Elements 
of J-dXc are pairs of points in dXc that lie in the same fiber of vr. 

Generalizing a construction in |15j . given s S S let GOs be the *— algebra of 
all pseudodifferential operators, acting on the space of half-densities C°° 
where Fg is the fiber of vr : dXc — ?• S above s. Let &£> be the sheaf of *— algebras 
on S whose stalk at s is ©Dg. We will say that a section k of (3D is smooth if the 
Schwartz kernel of the operator k{s) depends smoothly on s G S. The Schwartz 
kernel theorem, applied fiber-wise to the fibers of tt, together with the natural 
symplectic structure of S yield the following: 

Proposition 3.15. The vector space of smooth sections of the sheaf &D is natu- 
rally isomorphic to the space of half- densities on FdXc \ S that extend to FdXc 
as a conormal distribution to S 
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Proof. Let 7 = (71,72) G J^dXc, s 
following fiber product diagram: 



7r(7i) = '''"(72) S S. One then has the 



T^FdXc 



dlT2 

and so we get the exact sequence 
T^FdX^ - 

V I ^ (dlTlV , d'K2v) 



d-K 



d-K 



T^^ dXc 



r^2 dXc 



{VI,V2) h 

This gives a natural identification 



d-K{v2) — dlT^Vl) 



iTyFdXJ^/'^ ® IT^, dXc © Ty,dXJ 



'1/2 



\TsS\ 



1/2 



Since S is a symplectic manifold, there is a canonical half-density on TgS, and we 
get an identification 



iT^FdX, 



1 1/2 



1/2 



1 1/2 



1 1/2 



Finally, given a half density in Try^dXc, k = 1,2, we need to get a half-density in 
T^i^Fg, where Fg is the fiber of tt above s. We have the following exact sequence: 



^ ker diT^, ^ T^^dXc ^ FsS — 

which, by the same process as above, gives an identification 







T F 



1 1/2 



ker dn. 



1 1/2 



Hence 



\T^FdX, 



1 1/2 



\T F 



1 1/2 



Ik I 



T F 



1 1/2 



1/2 



- (71:72) 



(i^s X Fs 



1 1/2 



1 1/2 
1/2 



This gives a smooth isomorphism between two line bundles over FdXc- \TFdX^ 

and the line bundle T — )• FdXc whose fiber over (71,72) is |r(^^ ,y2)(-^s x Fs)\ 
where '7r(7i) = s = vr(72). Clearly a section of the sheaf GO is a distributional 
section of T conormal to S, and by the previous isomorphism this is equivalent to 
a distributional section of \FFdXf 



1 1/2 



conormal to S. 



□ 



The previous isomorphism yields an algebra structure on the space of distribu- 
tional half densities on FdX^ which are conormal to S. Analogously as in |15j 
(Proposition 2.7), one can see that the algebraic structure on this space is given, 
away from S, by the composition of half densities regarded as symbols of Fourier 
integral operators associated to FdX^- 
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Let us now take A € J^'"^. The symbol cri{A) in J-dXc \ S blows-up as the 
point where ai is evaluated tends to the intersection. In fact, in [1] it was shown 
that this symbol has a natural extension to a distribution conormal to S. Using 
the same identification above, this determines the kernel of a Pseudodifferential 
operator on the fiber above each point of S. We have proved: 

Proposition 3.16. For A G J^'"^ {M x M,A,I'dXc), the symbol ai{A) can be 
identified with a global section of the sheaf &D, that is, with a family of classical 
pseudodifferential operators of order m' = m—1/2 acting on fibers of n : dXc — )• S 
(orbits in the flow-out). 

For each s £ S and Fs the corresponding fiber above s, let us denote this 
operator by ai{A)g: 

C°° (Fs) {Fs) 

As a result, there is a well-defined symbol 

a{a{A)s):T*Fs\O^C. 

As we will now see, this symbol is related to the symbol ctq^A) of A on the diagonal. 
(This is the compatibility of the symbols of A announced earlier.) 

Let P be a defining function of dXc with a 27r-periodic flow on dXc- We have 
the following diffeomorphism 

dXc X 51 ^ J^dXc 

{x,t) I 

from which one can see that, for any 7 = (x, x) G S = AoJ^dXc, there is a natural 
isomorphism 

normal space to S in J-dXc at 7). Therefore, for each x G dXc, 

T^Fs is isomorphic to the dual space (yN^^'^"^ . 

Now let := T^A/T^T. be the normal space to S in A at 7. By [Jl], N^^^" 
and are supplementary Lagrangian subspaces of the two-dimensional symplec- 
tic vector space W = (T^S)^ /T^S. Therefore, N^^^^ and are in duality with 
each other (they are canonically paired by the symplectic form of W). In the end 
we obtain a natural isomorphism 

T-^Fs = (iVs^''^")* = iVs • 

The symbol of A on the diagonal belongs to a class (iloS'^^S) of smooth 
functions on A \ S which blow up at a prescribed rate at S (see [TT] for more 

20 



details). Every element in this class determines a smooth function on \ {0}. 
The compatibility condition alluded to in the Introduction is the following: 

Theorem 3.17. The symbol of A € J^'"' {M x M,A,TdXc) on the flow-out, 
identified with a family {ai{A)s}s£s of pseudodifferential operators along the fibers 
Fs, satisfies that for each x £ Fs 



(3.10) 



and 



a{ai{A)s)x{-T) = lim y^r^ 



P™' (17) ' 



where t £ T^Fg is the dual of the Hamilton field of P atx regarded as an element 
in TxFs, and the two limits are taken from the interior of Xc and the exterior of 
Xc, respectively. Moreover, this condition is intrinsic, i.e., it does not depend on 
the choice of P. 

The proof reduces to the model case, where it is immediate. One can also verify 
directly that changing P by a multiplicative factor does not alter the relationships 

The symbols in the flow-out become more natural under the present setting, as 
can be seen in the following symbolic version of Proposition 12.71 

Proposition 3.18. The composition of properly supported operators with kernels 
in J^'™ and J^'™, respectively, is an operator with kernel in j^+^+i/2,m+'m-i/2_ jp^^ 
any A G J^'"^, B E J^'"^, we obtain the usual symbol in the diagonal: 

Vx £ Xc\ dXc ao{A o B){x,x) = aQ{A){x,x)cro{B){x,x), 
and for any fiber Fg above s £ S, 

ai{AoB)s = ai{A)soai{B)s . 

3.5. The adjoint. The class J^'™- is closed under the operation of taking adjoints, 
and information about the symbol of the adjoint is given in the following 

Proposition 3.19. Let A £ J^'^'iM x M; A,J='dXc), then the adjoint A* belongs 
again to j'^'"'{M x M;A,TdXc), and 



ao{A*){x,x) = ao{A){x,x) /or (x, x) G A \ S, and 

ai{A*)s = {ai{A)s)* , for each s £ S. 

Proof. The first statement is as in the usual theory of ?i-pseudodifferential oper- 
ators. It is enough to prove the rest in the model case. Take A with Schwartz 
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kernel 



(27r/i)'^ J 



where a £ -^ii^sicai^ ^ ~ -^ + 1/2, w-' = m — 1/2. The Schwartz kernel of the 
adjoint is given by 

K\x,y) = K^) = ^^ I e*'^-H(-?')f-^f i)+--a(-s, y, x,p, a, h)dsdpda, 

where a{s,x,p,a,h) was replaced by a{—s,y,x,p,a,h). Taking x = {x,{pi = 
^iP'))iy = <?^f^ = {{xi + s,x')^ {pi = 0,p')), the symbol in the flow-out is given by 



(Ji(yl*)((/>f X, x) = \/27r / a_^'(— s, y, x,p, a)e^^'^ da^J dxdy\dp' \ 



,Pl=0,s=a;i-j;i 



27r / a^ii{—s,y,x,p,a)e ^^°'da\/ dxdyidp' \ = ai{A){x, (p^x) 

J \x' = y' ,pi=0,yi—xi = ~2 

The proof is now clear, since the symbol ai{A*) intertwines the variables and takes 
the conjugate of (7i{A). □ 

4. ASYMPTOTICS OF THE TRACE 

4.1. The trace in case m' > 0. We now assume that Xc is compact and dXc is 
fibrating, as in section [3j We will prove: 

Theorem 4.1. Let A be an operator in the class Ax^- Then, if m > 1/2, 

(4.1) Tr(l) = (27r)-"7i-^-™-" / ao(x,x,p, -p)dxdp + ©(/I'^-'^-'^+i), 
where ctq is the symbol of A on the diagonal. If m = 1/2, 

(4.2) Tr(I) = (27r)-"?i-^-'""" / ao{x,x,p, -p)dxdp + 0{h^^~'^-'' h log{l/h)). 

The rest of this subsection is devoted to a proof of this result, which we break 
into a series of lemmas. Note that it is enough to estimate the integral along the 
diagonal of the kernel of A in the model case with i' = 0. Consider therefore a 
semiclassical kernel of the form: 

(4.3) un{x,y) = — ^ / e'^"^^^'-y'-'^P'+^^'~y'^P'^+''''a{s,x,y,p,a)dsdpda, 

(27r/i)" J 

where p = {pi,p'), x = {xi,x'), y = {yi,y') and a is a classical symbol in a of 
degree m' = m — 1/2, compactly supported in {s,x,y,p). 
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Lemma 4.2. Let /xq > 6e large enough so that a|{|pi|>;iQ/2} = 0, and let p G 
be a smooth function with compact support which is equal to one in [— ^o/2,^o/2] 
and is supported in [— /Uqi^o]- Then 

(4.4) un{x,x) = j e-'-'i''/^+''''a{s,x,x,p,a)p{ha)dsdpda + Oih'^), 

uniformly in x. 

Proof. The rigorous definition of Uh wfien the integral in a diverges is given in 
equation ()2.3p : If K >> {K > m' /2 + 1), then Uh is equal to the absolutely 
convergent integral 



ih ^\{xi-y-i-s)v\+{x' -y')p']+isa -*- jjK 

(2vrn)" J (1 + 



e 



dsdpda, 



and therefore 

K 



Unix, y) = ^ g / e^'-'^^^-y^'^-^^^^- {-^h-'vlf''-' "-^^^^^^ dsdpda, 

where the last expression is obtained by expanding the action of D^'^ . Note that, 
Vj, Oj consists of linear combinations of derivatives of a with respect to s (and 
therefore aj G J^'"^^'). Using this we get that the remainder in equation (|4.4p is 
equal to 

£ (2^^ / e---/^--^^^|^^ {-^n'h.r-^ (1 - P{na)) dsdpda. 

Let bj{s,x,p,a ; h) = ^^^^(-i/i- V)^^"^' (1 - pi^))- We wih show that 
for each j, 

is 0(/i°°) 

Starting with the change of variables p = ha, uj = —pi + p, we obtain that 

Bj = - — -— / e^^'^^'^ bj(s,x,(-uj + p,p'),h~^p ■,h) dsdudp'dp 
(27rn)" J 

= J e-''<^^'cj{x,p,p' ; h ; C)d^dp'dp, 

where ^ = (^1,^2) are the dual variables to {s,u), and 

Cj{x,p,p ; h ; = ^ J e~^^'^''^^^ bj{s,x,{—OJ + p,p),h~^ p ; h)dsduj 

23 



is the Fourier transform of bj in the (s, uj) variables. Using the inequahty 

^-^^N 



(4.5) 

we obtain that for each > 



N-l 



E 

fc=0 



< 



m 



k=0 



where \Rn{^ ; ^)I < ^^^%r^- Moreover, for each A: = 0, . . . , iV - 1, 



k\ 



2 \ ^ 



{l + {h ' " ' ' 



since p{^) is equal to one in the support of a. It follows that 



0, 



N 



2t:N\ 



< 



where ||-||ii denotes the L^-norm of a function of the ^ variables. The well-known 
inequality 

(4.6) II*IIli{r^)< E 11^"^ 

|a|<d+l 

implies that the above bound is in turn bounded by 



N 



2irNl 



E 

|a|<3 



& 



\ dsdoj J 



Ll. 



N 



\dsduj J 



Ti ■ 
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where |MIli„ is defined similarly, and 9" = -g^^ = (01,02). Therefore Bj 

is bounded above by 



f^-n+N-2K+j 



\a\<3 



f d"^ \^ r(-w + /i)^'^^ ^aj{s,x,{-uj + fi,p'),h V) 



L (1 + V)^)' 

(1 — p{fJ-)) dsdujdp' dfi 



f^-n+N+l-2K+j 

(27r)"+iiV! 



E 

|a|<3 



5° 



92 



dsdpi 



N 



dsdpda. 

and that 1 — pificr) has support 



Finally, notice that the integrand is O ^fj™ 
in |cj| > Therefore the above upper bound is less than a constant times 



^-n+N+l-2K+j 



a^'-^'^da =f,-n+N+l-2K+, ^ 

s-Vo/2 m'-2K + l 



00 



O K> 



-n-m'+N 



Since this is true for all positive integers we are done. 



□ 



Lemma 4.3. If m' > 0, 

(4.7) 



Ufi{x, x) dx 



(27r/i) 

Proof. By (j4.4p . it suffices to estimate 

1 



-^y^ J 2Tr a{0,x,x, n,p ,h ^ n) dx dp dp. + 0{h 



n—m'+l 



)• 



Uh{x,x) 



ispi/h+isa 



a{s, X, x,p, a)p{ha)dsdpda. 



{2-KhY 

By an argument identical to the one used in the proof of the Lemma, 



(x,x) = - — t:— fi ^ 1 e^^^^'^'a{s,x,x,(—(jj + p,p'),h ^ p)p(p)dsdp' dojdp. 
(27r?i)" J 



We will apply the method of stationary phase to the (5,0;) integral, before inte- 
grating with respect to p' and p. To this end introduce the notation 

un{x,x,p',p) = j^^^^ j e''"^^''''a{s,x,x,{-u} + p,p'),h~^p)p{p)dsdu;, 

so that the left-hand side of (j4.7p is equal to J Ufi{x,x,p' , p) dxdp'dp modulo 
0{?f°). We also have that 

un{x,x,p',p) = j^^j-^ j e-'^^^^^c{x,p,p'; h ; 
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where ^ = (^1,^2) are the dual variables to {s,u)), and 



2tt J 

is the Fourier transform of pa in (5,0;). Note that 

c{x,p,p; h; ^)d£, = 27r a{0,x,x,{fj,,p),h~^p), 
and therefore (by ()4.5p ) 



(4.8) un{x,x,p',p)' 



1 



2-K a{0,x,x,{p,p'),h ^p) 



1 



where \R{(,,h)\ < ?i|'^i^2|- Integrating ()4.8p we see that the error term in ()4.7p is 
bounded by 



(4.9) 



- — -— / \\Rc\\ti(x,p' ri) dx dp' dn, 
(27r/i)" Jk « 



where is a compact set containing the support of the left-hand side of 
Using (|4.6p again, 



^iiei^ci 



h 

'l~2^ 

< — > 



-t{s,ui)-i a(s,x,x, (-UJ + p,p), h~^p)p(p)dsduj 

OSOUl 



\a\<3 



dsdoj 



a{s,x,x,{-uj + p,p),h ^p)p{p) 



Since a(s, x, a) is a classical symbol in a of order m! and compactly supported 
in the rest of the variables, Va there exists a constant C = C{a) such that 

-a(s, X, X, (-W + ), V)p(/") 



(4.10) 



27r ^ 9s9a; 



< C(a) (l + ^i-Vl)"' ^ 
C(a)(;i+ 1^1 )'"' 



for all {s,x,y,p). Integrating (j4.10p with respect to {s,uj) over a sufficiently large 
compact set we obtain that 

\\Rc\\L^{x,p',p)<C{h+\p\r' h-^'+\ 

We now integrate this inequality over the compact set, in (14. 9p . to obtain that 
the error term in (14. 7p is bounded above by a constant times 



(4.11) 



-m' —n+l 



{h+ \p\)'^ dp 



'\^l\<^ll 

for some ;Ui > independent of h, and this is 0(^~'"'~"'^^) when m' > 0. □ 

26 



Remark 4.4. Lemma [4.31 implies the Theorem (with a better error estimate in case 
m' = 0) if the ampHtude a is homogeneous in the variable a. 



Proof of Theorem \4-l\ Let us first assume that m' > 0. Since a is a symbol in a 
of degree m' > 0, there exists a{x,p) and a constant C such that 

\m' — I 



a{0,x,x,p,a) - cj™ a{x,p)x{cr] 



<C {l + \a\ 



where x{^) is smooth in a ^ 0, and homogeneous of degree zero in a. Then, in 
particular, 



2tt 



{2Tih) 



- a{0,x,x,n,p',h V) 



2tt 



^-™V™'x(^)a(0,x,(/i,p')) 



< (27r)i^"C (1 + n-Vl)""'"^^""- 
The left-hand side of this inequality is supported in G [— /Uq, fJ-o]- After integrating 
with respect to fi, the remainder is bounded by constant times 

-n— m'+l 

X -r ,0 ipiy u,p — ^,1, 

-MO 

= 2;i-"-'"'+i (^(/lo + - h""'^ /m' = 0{h-''-"''+^) since m' > 0. 
Therefore, for any i' and m' > 

un{x,x)dx = {27r)-''h-^-'^-'' 



(1 + h'^\n\r -^dti = 2h-" +W {h + //)™ -^dii 

-an Jo 



2tt p^ a(0, X, p)dxdp + 0(/i' 



-f— m— n+l \ 



where 27r p™'a(0,x,p) is the principal symbol on the diagonal. 

Now let's assume m' = 0. Since a is a symbol in a of degree zero, there exists 
d{x,p) such that, 

(J 

\a{0,x,x,p,a) - d{x,p)x{cr)\ < 



1 + k 



for some constant C > O.Then 
27r 



;a{0,x,x,n,p,h V) 



2tt 



-d{x,{n,p'))x{f^) 



< T — 1 1 I I ^ 
1 + 1^1 



Again, since the left hand side is supported in the set < hq}, after integrat- 
ing with respect to the remainder is bounded by a constant times 



A*0 



1 



— - — dil = h 

II 



-71+1 



jjL + h 



dfi 



= {logino + h)- log{h)) = 0{h^''+^ log{l/h)). 

Therefore, for m = 1/2 



un{x , x) dx = {2Tr) "'h 



27r a(0, x,p)dpdx + 0{K 
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log(l/^)), 



where 27r d{0,x,p) is the principal symbol of the family on the diagonal. 
4.2. The trace in case m' < —4. 

Theorem 4.5. With the previous notation, if m < —7/2, and A an operator in 
Axc! then each classical ^DO ai{A)s obtained from the symbol of A in the flow 
out on each orbit is of trace class, and 

(4.12) Tr(l) = (2^)-"+^/2;j-"-^+i/2 f {ai{A)s) ds + 0(/i-"-^+3/2). 

Js 

Lemma 4.6. If m' < and £' = 0, 

(4.13) / un(x,x)dx = —^——2tt f a(0,x,x, fi,p' ,h~^ fi) dx dp' dfi + 0(h~"-'^'^). 
J (27rn)" J 

Proof. This follows immediately from (|4.1ip (which was derived under no assump- 
tions on m'). □ 

Proof. Starting with equation (|4.3p . since m' < —4 

a2{s,x,y,p) := j e"'''a{s,x,y,p,a)da 

is absolutely convergent and can be extended to a function of s. In addition, 
02 is compactly supported in s, x, y,p. Using the stationary phase theorem for C^'^ 
amplitudes (Theorem 7.7.5 in [l8]), we get 

J e*^' '^^^02(3, X, X, — pi,p)dsdpi 2Tr ha2{0,x,x,0,p), 

and then 

ur,,(2;,x)(ix = (2^)-"+i/2;i-«-^+i/2 f ^/2^a2{0,x,x,0,p')dxdp'+O{h-''-^+^/^), 



where ^/2tt 02(0, x, x, 0,p') = V2tt f e'^'^'^a{s,x,x,p)dai is the extension of 

I s=0,px=0 

the symbol cri to the intersection of the Lagrangians. This is the desired result in 
the model case. □ 

5. Projectors and "cut" quantum observables 

In this section we will prove that, under a mild additional condition on dXc, 
the algebra Ax^ contains orthogonal projectors. We will also prove that, in case 
there exists an /i-pseudodifferential operator on M, P, such that: 

(1) The spectrum of P is discrete and is contained in hZ, and 

(2) Xc = P^'^il) for / C M a closed interval, 

then the spectral projector of P associated to the interval / is in Ax^ 
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5.1. On the Existence of Projectors. In addition to the assumptions on dXc 
that we have been making throughout, let us now assume that dXc is of contact 
type. Recall that this means that there exists a one-form /3 on dXc such that (a) 
d/3 is the pull-back of the symplectic form to dXc, and (b) /3jHp is constant, where 
P is a defining function of Xc with periodic flow on dXc- 
Following the proof of Lemma 5 in [3], one obtains: 

Lemma 5.1. There exists an smooth function, which will be called again P : 
T*M ^R, such that 

(a) P is bounded from below and tends to oo at infinity in the cotangent direc- 
tions, 

(b) dXc = P-^{0), and 

(c) There exists a neighborhood W of dX^ such that the Hamilton flow of P is 
27r -periodic in W. 

Next we recall (see [T7] Proposition 3.8) how to obtain a quantum version of the 
previous result: 

Lemma 5.2. Let P{h) be a semiclassical pseudodifferential operator with principal 
symbol P and vanishing sub-principal symbol. Let fi be the Maslov index of the tra- 
jectories of^^ (the Hamilton flow of P) inW. Assume the Bohr-Summerfeld con- 
ditions ()3.ip . Then there exists a semiclassical pseudodifferential operator i?2(^) 
of order —2 such that for e << 1 

Spec (P-^h- R2{fi)) n [-e/3, e/3] C HZ 

when we restrict h to the sequence h = 1/N with N large. 

Proof. Pick e > such that P~^[—e,e] C W. Let p be a smooth function with 
support in [— e,e], such that p = 1 on [— e/2,e/2]. Let 

7 = ^^ p{t)x{t)-P{x{t),p{t))dt 

be the (common) action of the trajectories of the Hamilton flow of P in W. Then 
^-2mh {P-j fi-i) jg niicrolocally in W a pseudodifferential operator with symbol 
identically equal to one, and thus one can write 

^(p)g-2^ifi-i(P-f fi-7) = p{P){I + hR{h)), 

where R{h) is a zeroth order ^-^'DO. Recall that 7 is an integer in dXc, and 
therefore, for h = 1/N we obtain 
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Since I + hR(h)p{P) has spectrum close to 1 for ^ << 1, one can then define for 
h small 

R2 = -^\og{i + hR{h)p{P)), 

and since R2 commutes with P, we obtain 

p(p)e"2-*'"'~H-p-f '"'-■^2) = p{p) (^i + hR{h)^ [i + hR{h)p{P)y^ . 

Since p = 1 on [— e/2, e/2], the spectral theorem guarantees that the above operator 
is the identity on any eigenfunction of P with eigenvalue in e/2]. Since, 

for h small enough, the spectrum oi P — ^ h — R2 vn [— e/3, e/3] corresponds to 
eigenfunctions of P with eigenvalues in [—e/2, e/2], the result follows. □ 

Let us define P2 := P — j h — R2, whose principal symbol continues to be P. 
Let X be the characteristic function on (— oo,0], and define the projector 

n = X (^^2) 

Theorem 5.3. The projector H defined above belongs to the class J~^/^'^/^(M x 
M,A,TdXc). 

Proof. Let p be the cut-off function of the previous proof. We decompose 

n = (1 - p)x [h] + px [h] 

Clearly {l—p)x (^-^2^ is a semiclassical pseudodifferential operator. Therefore we 

need to prove that p x (-^2^ belongs to J~^/^'^/^. This operator has microsupport 
in W. 

We take W^~^ x as the model case with coordinates {x, 6) and T*(]R"^-'^ x 5^) 
with coordinates {x,d;p,T). Let = Uff be the projector on eigenfunctions of 
P^ := hDg = j-§Q with eigenvalues greater than or equal to E/N, where E £ is 
a constant. (Here 6 is the 27r-periodic variable in S^.) Let Tg = e^*'^'^ and let 

1 g e 

be the translation representation on L^(M"~^ x 5^). Let (xo,Po) G VV. As in [T31I7]. 
there exist an S^-invariant neighborhood U C W of (xo,Po) (the circle action given 
by the Hamilton flow of P), an S'-'^-invariant open set C T*(]R'^~^ x "S"-^), and an 
S'^-equivariant canonical transformation 
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which sends dXc nU into {{x,e;p,T) G T* (R"^^ x S^) \ t = E}. Again, as in 
[131 [7] , one can show that there exists a semiclassical zeroth order Fourier integral 
operator 

with microsupport on ^ x such that 

F*F = Iun, FF* = Iu, 

and 

Fp x{P2) = P (n^) F, 

This reduces the proof to the model case. It suffices to show that HQ is on the 
algebra, for any zeroth order compactly supported semiclassical pseudodifferential 
operator Q in R"--^ X S^. Note that 

g = ^ ^\-^NsP-^iNsE Q ^^rf. 

The operator e~*^**^"e*^'*^Q is a semiclassical FIO with Lagrangian 
{{{x,e ; p,T = E),{y = x,a + s = 9 ; -p,-T = -E)) \x G W^^,e,a G [0,27r]} . 

Therefore, in local coordinates, the Schwartz kernel of Tl^Q can be written as 

where q is symbol with expansion in h. Notice that is a conormal distribution 
in s = and equation ()5.ip shows the hybrid nature of the amplitude of the 
projector. Equation (jS.ip also proves that Yi^Q G J~^/^'^/^, with principal symbol 
XXcQ{x,d ; P,t) in the diagonal, and 

1 Q{^f{x,9 ; p,t)) 
V2^ 1 - e^' 

in the flow-out. □ 

Remark 5.4. If one has an /i-pseudodifferential operator P with discrete spectrum 
such that 

Spec(P(;i)) C hZ, 

then the previous proof shows that, for any given Ei, E2 £ such that Ei < E2, 
and for j = 1, 2: 

the trajectories on P~^{Ej) satisfy the Bohr-Sommerfeld condition (|3.ip . 
Then the orthogonal projector onto 

Hn = span of eigenvectors of P{K) with eigenvalues in [£'1, £"2], 
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is in the algebra J i/2'i/2 (^m x M; A,J='dXc), associated to 

Xc = {x£ T*M I El < P{x) < E2} . 

5.2. Cut quantum observables. In this section we fix a projector 11 as in §5.1, 
and consider "cut" quantum observables, by which we mean operators of the form 

UQU 

where Q is a pseudodifferential operator on M. By Theorem 15.31 these operators 
are in J~^/'^'^/'^ (M x M; A,TdXc). The symbolic properties of these operators 
are summarized by the following Proposition: 

Proposition 5.5. Let Q{h) be a zeroth-order semiclassical pseudodifferential op- 
erator with compact micro support. Then IIQIl is in the class J~-^/^'^/^(M x 
M ; A,J^dXc). Its symbols, ignoring Maslov factors, are as follows: 

2) ao{UQir){x,x) = XXc{x)Q{x) ^/dxJTdp, 

(5.3) a,(nQn)^ = n,.M|,^^n,. 

where xXc characteristic function of Xc, x = {x,p) € T*M, Fs is the fiber 

above s £ S, Q\ is the restriction ofQ to Fg, Mn, is the operator "multiplication 

Is I Fs 

by Q\p andllp^ is the Szego projector in the orbit Fg, i.e., foru : Fg ^ C smooth, 

uiKv) = uM^, i^F.um = E,>0 

Remark 5.6. Notice that the Szego projector 11^^ is a classical pseudodifferential 
operator with principal symbol X{t*Fs)+^ where {T*Fg)~^ is the part with positive 
momentum variable, in the direction of the Hamilton flow. This function is smooth 
in T*Fg \ 0. 

Remark 5.7. The symbol of H^^^Mq^^ U^^^ is X{t*Fs)+Q\fs^ which agrees with the 
symbol in the diagonal, restricted to the intersection. This is the so-called symbolic 
compatibility condition referred to in Theorem 13.171 

Proof. The first part was proven in Theorem 15.31 The principal symbol in the 
diagonal is clear. Using the relation (0.2) in [1], we obtain that for y G dXc, s 7^ 0, 

(^li^s (y) ; y) = / — iTTrrir^ — itj^^ 



1 1 f'^'Qi^fm) 1 



V27f 27r Jo 1 - e*^ 1 - e*(^-^) 
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ds. 



Since Q{^f{y)) is a smooth 27r-periodic function in s, there exists a sequence of 
functions {Qjiy)}^_^ such that 



MS 



and the symbol becomes: 
1 1 



(y) ; y) 



27r 27r 



j=-oo 



Qj{y) 



> fc>0 



, fc'>0 



1 1 

2^ 1 - e» 



Qi(j') , Qjiy) 



j>0 



27r V27r 



We now interpret this as the kernel of an operator acting on the fibers of dXc — > 
S. Let us consider a fiber Fg C dXc, and a function u : Fg ^ C For every fixed 
y G 9Xc, let ttr(y) and Qj{y) be the corresponding Fourier coefficients in each 
decomposition 



u 



($fy) = E n.(y)-=, Q($fy) = E 

v27r . — -W Ztt 

r=—oo ^ j=—oo ^ 



As a pseudo differential operator, the symbol in in the flow-out of HQn acting the 

function u, is given by 

(5.4) 



fji ( UQU ] u 



[x)= / ai{UQU){x,y)u{y)dy = / ai{UQU){x,^^x)u{^fx)ds 
Jfs Js^ 



1 



1 



27r 1 - e- 

Qj{x 



Qj(x) 



Ur{x)^-;=ds 

^ V2^ 



= E n,.(j;)- 

^•>0,j>-r 

On the other hand 



^fM\^, ^f. in)\ ix) = n^,M|,^ I E ^ ) (^) = ( Q(^) E ^ l(^) 



, r->0 



r>0 



n^i Q«x)E 



r>0 



27r 



s=0 



U6Z,r>0 ^ 



■Ur{x)- 



2tt 
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r>Oj>— r 

which agrees with equation (j5.4p . This proves 



which yields (j5.3p after applying Proposition 13. 181 



□ 



Operators of the form IlpfQj^iIlj^ : ^ 7i]\f generalize Toeplitz matrices, and 
this is reflected in its principal symbol in TdXc- (In case M = 5^ and Hn the 
projector onto the span of {e*-'^, j = 0, . . . , N}, the UnQn'^n are to leading order 
the generalized Toeplitz matrices of [6], page 84.) 

5.2.1. Applications: A symbolic proof of the Szego Limit Theorem. We begin with 
the functional calculus, the heart of which is the following 

Lemma 5.8. Let Q be a self-adjoint pseudodifferential operator of order zero on 
M. Then 

jjg-ifflQn ^ j-i/2,1/2 ^ M;A,J^dXc) . 



Proof. Let us define 



Wit) = ne-^™^ 



It is the solution of the problem 

' dt 



(5.5) 



\§rW{t)+IiQIlW{t) = Q 



W{t)\ 



n 



The idea in the following proof is to construct a solution which will be in the 
algebra and will make the right-hand side of first equation (15. 5p of order 0{h°°). 
As a first approximation we take 



Wo = ne"**^. 



which satisfies 



ld_ 
~idi 



Wo + ngn Wo 



-n 



n,g 



-HQ 



We will prove below that Ii,Q G sc-L''^l'^{M x M;FdXc) (see Section [522]) • 
Therefore, we obtain 

' iiWo(t) + TlQTlWo(t) =: Ro{t) £ sc-I'^/^ (M x M;TdXc) 



Wo{t)i 



n 
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We will now modify Wq so as to make the right hand side 0{h°°) instead of an 
operator in sc-I^^^^{M x M; FdXc). For the rest of the proof, it will be conve- 
nient to identify symbols in the flow-out with corresponding families of smoothing 
operators acting on functions on the fibers Fs for each s £ S. The symbol -Ro(*) 
has a corresponding family operator {7^o,s(0}se5- Let us consider the following 
problem, 

< _ 

Vo,s| = 0, 

whose solution is 

Jo 

Notice that Vo,s is a smoothing operator. Let us call Vq the smooth symbol in 
FdXc given by the operator Vo,s- Take Vq G sc-/~^/^(M x M]FdXc) with symbol 
Vq. By construction 

(^0 + ^^o) + ngn {wo + yo)= hRi{t) g sc-/-^/^ (m x M; Fdx^) . 

Proceeding inductively one can find a sequence of operators Vj such that for all J 

(5.6) '^'\ U ) \ U ) 

= h-^+^Rj+i G sc-/-^/2-J X M-FdXc) 

Finally, take an operator V G sc-/-^/2(M x M; FdXc) such that V ~ T.f=Q Vj, 
and define W = Wq + V. Then 

-^W + YiQYiW = 0{K^). 
i at 

A standard application of Duhamel's principle finishes the proof. □ 

Proposition 5.9. Let Q be a self-adjoint semiclassical pseudodijjerential opera- 
tor. Then for any smooth function f, Ilf(IlQIl), is in the class J^^/^'^/^(M x 
M ; A,FdXc). The symbols, ignoring Maslov factors, are as follows: 

(5.7) ao (n /(ngn)) (x, x) = xx. {x)f {Q{x)) Vd^T^d^, and 

(5.8) ^1 (n /(ngn)) = n^., / (^f^q,^^ Hf) , 

where Fs,Q^p , ^Q\p > o,^d Hf^ (^f^ o,s in Proposition 15.51 
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Proof. We have: 
(5.9) 



UflUQU 



where f{t) = ^ / e''f{s)ds. By the previous lemma we can conclude that 
n/(nQn) G Moreover 

1 



ao{UfiUQU)){x,x) 



"''^^'^^XxMlm = f{Q{x)) xx.(x), 



and 



ai (n/(nQn))^ = j nF.e-^*"-^^'«-."-=/(t)(it = n^j(n^,MQ,^n^j. 



□ 



As an immediate corollary of Theorems 14.11 and 15.51 we obtain the following 
Szego limit theorem: 

Corollary 5.10. Assume that is compact. Then for any smooth function f 



TllUNfiUNQNUN. 



(2^) 



foQ— + 0{N^~' log(iV)) 



5.2.2. Commutators. We now describe another property of the projector. Let 
Q he a semiclassical pseudodifferential operator as above. The projector IT be- 



is 



haves microlocally as the identity on the interior Xc, suggesting that 11, Q 
microlocally 0{h°°) on the diagonal. Using Proposition 13.141 we anticipate that 
Il,Q G sc-I~^/^ (M X M; TdXc). We now prove that this is indeed the case, 
and compute the principal symbol of the commutator. 

Proposition 5.11. For any zeroth order compactly supported semiclassical pseu- 
dodifferential operator Q, IT, Q G sc-I^^/'^ {M x M;FdXc) is a semiclassical 
Fourier integral operator, with (smooth) principal symbol 



(5.10) 



n,g 



%y ; y) = ' 



( 1 Q(s/)-Q(x) 



ifx^y 
ifx = y. 



Furthermore, if the principal symbol of Q is constant along the orbits in the 
flow-out, the Hamilton flows <I>^ and <1>*^ of P and Q commute in dXc, and 
the subprincipal symbol of Q vanishes on dX^ (Levi condition), then 11, Q G 
/-5/2 X M;TdXc). 
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Remark 5.12. The Hamilton flow of the principal symbol of an operator that 
commutes with 11 preserves the region Xc- However, the converse is not true; 
the invariance of the region Xc is a much weaker condition than the commuting 
property. 

Proof. It is enough to prove it in the model case M"-^ x with coordinates {x,6) 
and r*(M"~^ x S^) with coordinates {x,6 ; p,t). We only consider one energy 
level, say E so that Xc = {t > E}. For simplicity, let us consider zeroth order 
semiclassical pseudodifferential operators of the form: 

= ^e*™^ [ q{x,p,6,hm)e'''P^'' f{p,m,h)dp, where 



f{p,m,n) = ^^-^j e-'yP/''e-^^y{y,a)dyda, 

and q{x,p, 6, s) is the full symbol. Decompose q in its Fourier modes, qk{x,p, 0, s) 
^ e^^^ qk{x,p, s). Then Q = YlQk-, where 

(5.11) Q,{h)f = ^e*™^ / e'''%k{x,p,hm)e'-P/''f{p,m,h)dp 

is a sc-^DO with symbol qk{x,p, s). The kernel of is 

Kq^ (x, y, e,a) = Y^ e*(^+-)^-^--p,(x, y, m, h), 

m 

where 

Pk{x,y,m,h) = ^2^;^^)n.+i j (i'^''~^^^'^'lk{x,p,hm)dp. 
A calculation shows that for /c > 0, 



[njv,Qfe{i/JV)] {x,e,y,a) 



(2^) 



n.+l 



^iN{x-y)p^iNE{e-~a) 



dp. 



0<j<fc 

Notice that the amplitude in the integral above (in brackets) has an expansion in 
powers of h, and in fact is a semiclassical symbol. The phase parametrizes the 
flow-out of {r = E} by the canonical action, which is FdXc. This proves that 
the commutator is in the corresponding class, and the principal symbol is 

^ y e-^.(^-»)e-^^g,(x,p,^) = ^^(^'^'^)^^'" - qk{x p,E)e^^^ _ 

0<j<k 

The case /c < is similar, and taking the sum over k, we obtain (jS.lOp . 
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For the last part, assume that the principal symbol is constant in the fibers of 



dXc — )• S, which implies that 



G sc-/^^/2 (M X M;TdXc). Assuming the 

Levi condition, we will show next that the principal symbol (corresponding to the 
degree —3/2) vanishes again. Take XQ,yQ G TdXc, xq / y^. Consider two zeroth 
order semiclassical pseudodifferential operators Ti, T2 of disjoint compact micro- 
support, such that their principal symbol is 1 in a neighborhood x, y respectively. 
Notice that 



(5.12) 



TiUT2,Q 



+ TiU 



Near {x,y), the symbol of Ti Il,Q 



Q,T2 



+ 



UT2. 



coincide. Consider, on the 



T2 and 

other hand, the first term on the right-hand side of equation (15.120 . First, by the 
assumption on the microsupports of Ti and T2, the operator T1IIT2 does not have 
wave-front set along the diagonal, and therefore it is in sc-/~^/^ (M x M; TdXc). 
We can then apply Proposition l6.3l below to compute the symbol of the commutator 

TiIlT2,Q . Near (xo,yo) symbol T1IIT2 is equal to the symbol of 11, and 

clearly the (diagonal) Lie derivative of this symbol with respect to the Hamilton 
flow of Q is zero. Therefore the symbol of this commutator (as an operator of 
order —3/2) is zero. 

The principal symbols of the last two terms in ()5.12p also vanish because the 
principal symbols of Ti,T2 are constant near XQ,yQ, respectively. Therefore, the 

(—3/2) principal symbol of H,Q vanishes off the diagonal, and therefore every- 
where on FdXc by continuity. This concludes the proof. □ 



6. On some propagators e ^'^Q^ 

6.1. The classical counterpart. We begin by considering classical hamiltonians 
Q : T*M — >■ R with the property that their Hamilton field is tangent to dXc, that 
is, Hq(x) G TxdXf. for all x G dXc- It is easy to see that this occurs if and only 
if the Poisson bracket satisfies {P, Q}\^ = 0, and a as consequence, Q is constant 
on the fibers of dXc — s- S. The Hamilton flow of such a Q preserves the region Xc, 
that is, it defines a classical flow in the symplectic manifold with boundary X^- 
The restriction of Q to dXc descends to a smooth function Qs : S* — ?• M, which 
in turn defines a Hamilton flow on S. However, the following diagram (where 
denotes the Hamilton flow of Q, etc.) does not commute in general: 



(6.1) 



dX^ t_^C QJ^^ 

s ^ s 
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Lemma 6.1. Assume that Hg is tangent to dXc, and let P he a defining function 
of Xc, as above. Then the diagram (|6.ip commutes for all t if and only if the 
Poisson bracket of P and Q vanishes to second order at the boundary dX^, by 
which we mean that there exists a smooth function F such that 

{P,Q} = P^F. 

Proof Since Eq{x) G T^dX^ for all x e dX^ = ^"^0), then {Q,P}{x) = 
dPxl^o) = for all x S dXc- Therefore we can write {P, Q} = FqP for some 
smooth function Fq, and 

[Hp, Hq] = H|p^Q| = FoHp + P'~Fo 

will vanish on dX^ if and only if Fq itself vanishes on dX^. As a result, 

Vx S dXc if and only if {P, Q} vanishes to second order on dXc- □ 

We now discuss the relation of the above considerations with Lerman's symplec- 
tic cut construction. The "cut" space is 

Y = X,l ~, 

where the equivalence relation on X^ is: ?e ~ y iff x and y are on the boundary dX^ 
and in fact on the same leaf of dX^ — )• S. There is an obvious inclusion S ^ Y 
and it is clear that, as sets, 

(6.2) y = Int(X,)]JS 

(disjoint union). Let us give Y the quotient topology. Then a function Q satisfying 
{Q, P^\dXc — induces a continuous function Qy : 1" — >• M, which is smooth when 
restricted to each of the pieces in ()6.2p . If the Poisson bracket vanishes to second 
order, then, by the previous lemma, one has a commutative diagram 

X, 

(6.3) i 

Y 

where is a Hamilton flow defined piece-wise by restricting Q to the pieces in 
(ESI). 

In Lerman's construction the topological space Y acquires the structure of a 
symplectic manifold of which S* is a symplectic submanifold. However, in general, 
Qy is not smooth with respect to Lerman's structure; for this it is necessary that 
{Q, P}\dXc = to infinite order, as implied by the following lemma: 

Lemma 6.2. // {P,Q}\dXc = to order k, meaning that there exists a smooth 
function F such that {P,Q} = P^F, then Qy G C^~^{Y). 
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Xc 
i 

Y 



Proof. Take the model case M = M""i X with coordinates {x,9), T*M with 
canonical coordinates {x,9; p,t), and Xc = {{x,9; p,t)\t > O}. Then the sym- 



plectic cut is the manifold Y 



X (where the symplectic form on C is 



{^^^dz A dz)), and the projection Xc ^ Y is 

{x,e;p,T) ^ {x,p\^/^e''^). 

Any function Q{x,9;p,t) whose Hamilton flow preserves Xc descends to the con- 
tinuous function Qy on Y 

Qy{x,p,z) = Q(x,argz; p,\z\'^) 

for z 7^ and Qy{x,p, 0) = Q{x, 9 ; p,0) for any value of 9. (The continuity of Qy 
will be seen in what follows.) If {P, Q} vanishes to order k in dXc, then 

{P,Q} = ^ = r'F{x,9;p,T) 

for some smooth function F. This implies that there exist smooth functions 
Gi{x,9;p,t), G2(x ;p, t) such that 

Q = t'' Gi{x,9;p,t) + G2{x;p,t). 

It follows that 

|zP Gi(x,argz ; p, + G2{x ; p, if z / 

Qy{x,p,z) = < 

G2ix;p,0) if 2 = 0. 

Define Qy{x',C',z) = Qy{x' , z) - G2{x' ,\z\^ Then Qy and Qy differ by 
a smooth function, and therefore it suffices to show that Qy{x',^',z) is C^. For 
this, we'll show that a function of the form 

Izp'"' G(x, arg z ; p, jzp) if z / 



if z = 



is a function for any smooth function G{x, 9 ; p,t). The function & is smooth 
in the region z ^ 0, so we only need to show the existence and continuity of partial 
derivatives at z = 0. We will prove the statement by induction. Write z = {ui,U2)- 
For k = 1, 



dG^{x,p, z) 
dui 



lim 

Ml— >0 



ulG{x,0;p, uj] 

Ul 



0, 



and for z ^ 

qqI qq qq 

- — = 2uiG(x,argz; p, \z\'^)-U2^{x,sxgz ] p, |zp)+2ni|zp — (x, arg z ; p, l^p), 
oui o9 OT 
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which converges to zero as z — )• 0. The partial derivative with respect to U2 is 
similar, showing that G C^. 

Assume that the statement is valid for A: — 1 > 0. Notice that 



dui \dO J \9t J 



2kuiG''^' -U2[^] + 2ui — , and 



fc-i k 



2ku2G^ ^ +ui[ — ] + 2-^2 



du2 \90 J \dT J ' 

Each of the terms on the right-hand side of each of the equalities above are at least 
C''~^, finishing the proof. 

n 

6.2. A Symbolic Description of The Propagator e~** ^ ^nQn_ Throughout 
this section Q will denote a smooth function such that the Poisson bracket {P, Q} 
vanishes to second order at dXc (c.f. Lemma 16. ip . As we saw in the previous 
section we then obtain a classical flow $^|xc that descends to a continuous flow on 
the cut space Y. In this section we analyze the quantum mechanical propagator 
e~** ^ ^nQn^ where Q is a semiclassical pseudodifferential operator on M with 
symbol Q and whose subprincipal symbol satisfies 

Sub Qi =0. 

Before we state the main result, let us start with a proposition: 

Proposition 6.3. For each semiclassical Fourier integral operator V{h) in 
sc-I"^/"^ (M X M;FdXc), the commutator Q{h),V{h) is in the class 
sc-I~^^^ (M X M; TdXc) ■ Its principal symbol is 

where V is the principal symbol of V , and £=p is the Lie derivative obtained by 
letting the Hamilton flow of Q act diagonally on TdX^- 

Proof. Write the Schwartz kernel of Q in the model 
where 

q{y,p, ^) ~ 9o(y,p) + + • • • , 

and the Schwartz kernel of ^ G sc-/~^/^(M x M ; FdXc) as 
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where 

v{z,y,uj,h) ~ vo{z,y,ui) + hvi{z,y,uj) + ... 
Then the Schwartz kernel of y o Q is 



VoQ{z,x) 



1 



{2TThy 



{2-Khy 



^ih ^[{y-^)pH^'-y')^\y{^z,y,uj,h)q{y,p,h)dydp 



dhJ 



Applying the stationary phase method to the integral in brackets, one gets 
(6.4) 



1 



{2-KhY 



Jh i[(y-x)p+(x'-yH^(^^y^^^ fi)q{y,p, h)dydp 



Vo{z,x,uj)qo{x, (0,a;)) 



hdvQ{z,x,uj) dqo{x,p) 



i dx dp 
+ hvi{z,x,uj)qo{x, (0,0;)) + hvQ{z,x,uj)qi{x, (0,a;)) 
The Schwartz kernel oi Q oV can be written as 



h dqo{x,p) 
-vo{z,x,oj) — 
I oxop 



QoV{z,x) 



1 



J{z'-x')ui/h 



1 



^ih ^[(z-y)p+{y'-z')^]q^z,p, h)v{y, x, co, h)dpdy 



Applying stationary phase to the amplitude above, one gets 



doj 



{2'Khy 



Jh-^[{z-y)p+{y'-z')uj\ 



q{z,p, h)v{y,x,uj,h)dpdy 



(6.5) 



hdqo{z,p) dvo{z,x,uj) 
qo{z, {0,uj))vo{z,x,uj) + -- 



dz 



lp = (0,uj) 



i dp 

+ hqi{z, {0,uj))vo{z,x,uj) + hqo{z, {0,uj))vi{z, x,uj) 

Therefore, the commutator [Qj^] has as leading amplitude 

vo{z, x, u) {qo{z, (0, uj) - qo{x, (0, w))) . 

This vanishes at x' = z', which corresponds to the flow-out. Therefore [Q,V^] G 
sc-/~^/^(M X M ; FdXc). In order to compute the principal symbol there, we 
notice that 

qo{z, (0, uj)) - qo{x, (0, lo)) = {z' - x') ■ d{z, x, u), 
where d = (d2, . . . ,dn) is a vector- valued function such that 



d{z, X, uj) 



^x'Qoix, (0,a;))| 
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Therefore 



(27rn)' 

(6.6) = j e^(^'->/^X^(^.(-'-''-)-o(.,x,-))rfc.. 

The principal symbol of [Q,!^] in sc-/^'^/^(M x M ; FdXc) can be then com- 
puted taking all the contributions from equations (j6.4p . (j6.5p and ()6.6p . Since 
qo{x,p) is constant along the orbits, then 

d'^qo{x,p) d^qo{z,p) 



dxjdpj I dxjdpj 



for any j > 2. 



Since {Q,P} vanishes at second order on dXc, then i = 0. Assuming 

lpi=o 

all these conditions, and the fact that the subprincipal symbol 

n Q2 



Sub Q(x,p) = q\{x,p) 



2i ^ dxjdpi I 

vanishes on dXc, the principal symbol of the commutator reduces to 

dqo{z,p) dvo{z,x,uj) ^ dqo{x,p) dvo{z,x,uj) 

dp \ dz \ , , dp \ dx \ , , 

V=(0,u)) p=(0,i<j) 

■A dqo{x,p) dvo{z,x,uj) 
^ dxi I du \ , , 

J = 2 I x'^z' \x' = z' 

One can check that this is the Lie derivative of V with respect to the Hamiltonian 
field Hq in the sense in the statement of the lemma. □ 

Notice that there is a way to define classes J^'"^ for a general pair of admissible 
Lagrangian submanifolds that intersect cleanly (see \22\ [TT] ) , and not only for the 
diagonal and the flow-out of dXc- The main result of this section is the following: 

Theorem 6.4. Suppose Q is a zeroth-order semiclassical pseudodifferential oper- 
ator satisfying the conditions of Lemma \6.1\ Assume subQ{h) = 0. Then 

j^^-ith-^iiQn ^ j-i/2,1/2 ^ M; A(t),^5Xe(t)) , 

where 

(6.7) A(t) = {(x,y) \x,y G T*{M x M),x = cD«(y)} 
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(6i 



FdXc{t) = |x, y G dX^, 3s G M such that x = ^^^^{y)^ . 



Remark 6.5. In this statement t is a parameter, but we could also consider t as a 
variable (in which case the kernel of the operator would be a family of functions 
on M X M X M). Also, the symbols of He"**'' ^ngn easily be computed. 

Proof. Let us define the following operator: 

(6.9) W{t) := Ue-'^^''^^^ ^ith-^Q _ 

We first prove the following: 

Lemma 6.6. W{t) G J"^/^'-*^/^ (M x M;A,TdXc), and the principal symbol in 
the diagonal is do = XXc- 

Proof. Let us define Dt = i^. W{t) satisfies the following equation 



hDtW{t)+ Q,W{t) 



(6.10) 



+ 



U,Q 



W{t) = 



Wi 



n 



Similarly to the proof of Lemma [5. 81 using the symbol calculus we will construct 
a sequence of approximate solutions of equation ()6.10p . This construction makes 
the right-hand side of order 0{h°°), and an application of Duhamel's principle 
concludes the proof. 

As a first approximation we take Wq = IT. This is a sensible choice since 



h^S2 := hDtWo+ 



Q,Wo 



+ 



(/-n) G sc-/-^/2 (^j^f X M;TdXc) 



by Proposition 15.111 

We now modify Wq by elements in I(M x M; J-dXc) to lower the order of the 
remainder. It is easy to see that the symbol of the correction term is the solution 
to the problem 

'-'^^^ + £EMx,y,t) = -iS2, 



at 







where Si is the principal symbol of G sc-I ^/^(M x M]FdXc). Let Vi G 
sc-/~-^/^(MxM; FdXc) be an operator with this as symbol, and let Wi = Wq+KVi. 
Since n,Q G sc-r^/'^{M x M;FdXc) by Proposition EUl we get 

h^Sz := hDtWi + \q,wA + [n,Qj Wi G r'^'^iM X M;FdXc) 
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Proceeding inductively in this fashion, we obtain an infinite sequence {Vj} such 
that for all J 



HDt I Wo + J2^^^j I + 



+ 



3=1 



Next we take an operator V G sc-/-^/^ (^y/ x M ; .F^Xc) such that V ~ ^ ^^'Fj , 
and define W = Wo + V. □ 
Going back to the proof of the theorem, notice that 

The Lagrangian A(t) intersects A and TdXc transversally. Using a variation of 
the Proposition 4.1 in [11], we conclude that composing elements in J~^/^'^/^(Af x 
M; A, -FSXJ with e-^*'^^'^ gives elements in J-V2,i/2(7v/xM; A{t),FdXc{t)). □ 

6.3. An Egorov-type Theorem. We can easily prove the following corollary. 

Corollary 6.7. Let Q he a zeroth order semiclassical pseudodifferential operator 
satisfying the conditions of Lemma 16. il and the Levi condition. Then for any 
zeroth order semiclassical pseudodifferential operator A{h), we have 

B{t) := e'^t^-'^Q^uAUe-'^''''^^^ G J-V2,i/2 ^ M,A,J^dX^) , 

with the following principal symbols: 

ao{B{t)){x,x) = xXcix) (ao<^f(x)) /or (x, x) G A \ S, and 



where a is the principal symbol of A, the Hamilton flow Q, Fg is an orbit in 
dXc, and Ilp^ is the Szego projector of Fs. 

Proof. Let us consider W{t) as in equation (j6.9p . Notice that 

which proves it belongs to the algebra. Since is a semiclassical 

pseudodifferential operator with symbol a o <I)^, the symbol on the diagonal can 
be trivially obtained. To compute the symbol on the flow-out, we note that the 
principal symbols of W are exactly those of IT and we use Proposition 12. 7t 

ai{Bmy = ^f{x),x) = 
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As a pseudodifferential operator on the fibers, this is lips^iao^Q) ^Fs- ^ 

7. A NUMERICAL STUDY OF PROPAGATION OF COHERENT STATES 

Let Q be a zeroth order semiclassical pseudodifferential operator with symbol 
Q. It is well-known that, if V'{xo,po) ^ coherent state with center at {xq,pq), 
then e"**'* (V'(a;o,po)) ^ coherent state (appropriately "squeezed") with center 
at {xq,po), where 4>*^ is the Hamilton flow of Q. If the flow preserves Xc and 
the center {xq,pq) is in the interior of Xc, then the same conclusion holds for the 

propagation e~**'* ^'^ (V'(xo,po)) coherent state by IIQII, as the trajectory 

of the center will remain away from the boundary dXc and everything is as if we 
were in the boundaryless case. 

In this section we present results of a numerical calculation of e"**'^ (V'(a;o,po)) 
in an example where the Hamilton flow of Q does not preserve X^ that is, trajec- 
tories of cross the boundary dXc- 

We consider the Harmonic oscillator P = — h'^d'^) in M}, and the corre- 
sponding projector H onto the span of its eigenfunctions of with eigenvalues less 
than or equal to one. We take Q = x"^ — p^, and Q the obvious quantization of Q. 
Figure [T] shows some energy levels of Q. Notice that the energy levels cross the 
boundary of X^. = {x^ +p^ <2]. 




Figure 1. Energy levels of Q and the boundary dXc = {P = 1}. 

We now take a coherent state centered inside the interior of X^ and numerically 
compute its propagation under HQH. We do the calculation in Bargmann space, 
for symplicity. 
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We recall that the Bargmann space is defined as the Hilbert space 
S=|/:C^C: / entire and j \f{z)\^ e-^-^dm, < oo 
where dniz = dxdp and z = with the Hermitian inner product 

v2 



(/,£/) = J f{z)g{z)e ft dm^. 
The Harmonic oscillator in Bargmann space is given by 

with principal symbol P{z,z) = zz and eigenbasis 

Pbn = h{n + -]bn = XnK- 



The quantization of Q = — in Bargmann space is the operator Q = h^-^+z'^ 
Applying Q to the eigenbasis, we get 



Qibn) = h^/n{n - 1)6„_2 + h^/ {n + l){n + 2)bn+2, 

which gives a a "generalized" Toeplitz matrix for Il]\fQIl]^ for each positive integer 
N, where h= j^. The (normalized) coherent state in Bargmann space, with center 
at w, is given by the simple formula 



WW 



^w{z) = e ft e 2ft . 
We apply the propagator e"**'' ^'^nQ^n projected coherent state 

^^(z,iV) := njv^«,(^) = V ^— e 2ft 6„. 

In Bargmann space, we measure the concentration in phase space of any semi- 
classical family ip by taking the absolute value of the family times the square root 
of the Bargmann weight, namely, by forming the Husimi density: 

IVk(^) := \i^{z)\e-^-'/^\ 

We took as initial data a projected coherent state with center aX w = —0.25 — 0.6i, 
which corresponds to {x,p) = -v/2 (—0.25, 0.6). Figure [2] consists of contour plots 
of the Husimi density in the z variable of the initial projected coherent state, its 
propagation at t = 0.25 (approximately when the center of the coherent state hits 
the boundary), and at time t = 0.5. We observe that after the time of collision 
of the center with the boundary, the coherent state splits into two localized states 
with centers on inward trajectories and with the same classical energy. Here we 
took N = 100. The splitting happens immediately after the center collides with the 
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Figure 2. A coherent state is propagated by e-**^nNQnjv (g = x^-p^) 
at time < = (left), t = .25 (middle) and t = 0.5 (right). The contour 
plots of the Husimi densities at each time are shown. 

boundary; thus one can speak of infinite-propagation speed along tlie boundary. 
Note tliat tlie evolution is time-reversible, so that in some cases the opposite 
phenomenon will occur, namely, two localized states with same classical energy 
will hit the boundary at the same time and combine into one. 
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